MoE-SPNet: A mixture-of-experts scene parsing network

Pyramid Scene Parsing Network — Supplymentary Material

Mixture of Vector Experts

We describe and analyze an algorithm for predicting a sequence of n-dimensional binary vectors based on a set of experts making vector predictions in [0, 1]. We measure the loss of individual predictions by the 2-norm between the actual outcome vector and the prediction. The loss of an expert is then the sum of the losses experienced on individual trials. We obtain bounds for the loss of our ex...

Regularization and Error Bars for the Mixture of Experts Network

Viswanath Ramamurti and Joydeep Ghosh Department of Electrical and Computer Engineering The University of Texas at Austin, Austin, TX 78712-1084. E-mail: fviswa,[email protected] Abstract The mixture of experts architecture provides a modular approach to function approximation. Since di erent experts get attuned to di erent regions of the input space during the course of training, and ...

Mixture of Experts Classication Using a Hierarchical Mixture Model

A three-level hierarchical mixture model for classiŽcation is presented that models the following data generation process: (1) the data are generated by a Žnite number of sources (clusters), and (2) the generation mechanism of each source assumes the existence of individual internal class-labeled sources (subclusters of the external cluster). The model estimates the posterior probability of cla...

Mixture of Experts Classification Using a Hierarchical Mixture Model

A three-level hierarchical mixture model for classification is presented that models the following data generation process: (1) the data are generated by a finite number of sources (clusters), and (2) the generation mechanism of each source assumes the existence of individual internal class-labeled sources (subclusters of the external cluster). The model estimates the posterior probability of c...